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Abstract 

Suppose (M, (J) is a compact symplectic manifold acted on by a compact Lie group 
K in a Hamiltonian fashion, with moment map fi : M — > Lie(-fT)* and Marsden- 
Weinstein reduction M rec j = // -1 (0)/if. In our earlier paper |l7j], under the assumption 
that is a regular value of /i, we proved a formula (the residue formula) for rjQe" [M rec j] 
for any r/o £ H*(M ie d), where uq is the induced symplectic form on M re< }. This formula 
is given in terms of the restrictions of classes in the equivariant cohomology H^(M) of 
M to the components of the fixed point set of a maximal torus T in M. 

In this paper, we assume that M has a if-invariant Kahler structure. We apply 
the residue formula in the special case tjq = Td(M ve( \); when K acts freely on // _1 (0) 
this yields a formula for the Riemann-Roch number RR{C rcd ) of a holomorphic line 
bundle £ re d on M re d that descends from a holomorphic line bundle C on M for which 
ci(£) = u). More generally when is a regular value of fj,, so that M re ^ is an orbifold 
and £ re d is an orbifold bundle, Kawasaki's Riemann-Roch theorem for orbifolds can 
be applied. Using the holomorphic Lefschetz formula we similarly obtain a formula for 
the ^-invariant Riemann-Roch number RR K (C) of C In the case when the maximal 
torus T of K has dimension one (except in a few special circumstances), we show the 
two formulas are the same. Thus in this special case the residue formula is equivalent 
to the result of Guillemin and Sternberg @ that RR(C Tcd ) = RR K (£). 



*This material is based on work supported by the National Science Foundation under Grant No. 
9306029. 
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1 Introduction 



Let M be a compact symplectic manifold of (real) dimension 2m, acted on in a Hamiltonian 
fashion by a compact connected Lie group K with maximal torus T, and let k and t denote 
the Lie algebras of K and T. Let /i : M — ► k* be a moment map for this action. The reduced 
space M red is defined as 

M md = fi-'^/K. 

We shall assume throughout this paper that is a regular value of /i, so that M red is a 
symplectic orbifold; it has at worst finite quotient singularities and the symplectic form u 
on M induces a symplectic uq on M re d. 

There is a natural surjective ring homomorphism [F2TJ k>o : H^(M) — > if*(M re d), where 
Hk(M) is the i^-equivariant cohomology of M. The main result of |T/J was the residue 
formula (Theorem 8.1), which for any rjo G H*(M Tecl ) gives a formula for the evaluation of 
r^oe^ on the fundamental class of M re d. This is given in terms of the restrictions i* F i] to 
components F of the fixed point set of T in M, for any class r] G H* K (M) which maps to 770 
under kq. The residue formula is an application of the localization theorem of Berline and 
Vergne, a result on the equivariant cohomology of torus actions ||, for which a topological 
proof was later given by Atiyah and Bott 0. The residue formula is related to a result 



of Witten (the nonabelian localization theorem f27j): like the residue formula, Witten's 
theorem expresses ^o^ [M-ed] in terms of appropriate data on M. 

In this paper we assume also that there exists a line bundle £ on M for which C\(C) = to, 
with the action of K on M lifting to an action on the total space of £ (such a lift exists 
because the action of K on M is Hamiltonian; we choose the lift to be compatible with the 
chosen moment map). Under the assumption that K acts freely on /z -1 (0), we get a line 
bundle £ re d on M re d whose first Chern class is oj$, where u is the induced symplectic form 
on M r ed- In the more general case, £ re d is only an orbifold bundle. 

Suppose also that there exists a ii'-invariant Kahler structure on M; more precisely a 
complex structure compatible with u and preserved by the action of K. The bundle £ then 
acquires a holomorphic structure in a standard manner, and we define the quantizations 7i 
and Tired to be the virtual vector spaces 

H = ®j> (-l) j H j (M, £) (1.1) 

and 

Wred = © J > (-l) J ^(M rcd , £ red ). (1.2) 

The space Ti is a virtual representation of K. The Riemann-Roch numbers RR K (£) and 
RR(£ re d) are defined by 

RR K {£) = ^2(-l) j dimHi(M,£) K (1.3) 

j>0 

RR(£ rcd ) = £(-iydim^(M red ,£ re d). (1.4) 

The main result of this paper is that when the dimension of the maximal torus T is one, 
except in a few special circumstances, a particular case of our residue formula is equivalent 
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to the statement that these two Riemann-Roch numbers are equal: 



RR(C vcd ) = RR (C). (1.5) 

This statement was proved by Guillemin and Sternberg [14] under some additional positivity 
hypotheses on C, and was conjectured by them to hold more generally. It has been called 
the quantization conjecture: that quantization commutes with reduction. 

In this paper we show the following: 

Theorem 6.2: Suppose K is a compact connected group of rank one. Let K act in a 
Hamiltonian fashion on the symplectic manifold M , with a moment map /i for the action 
of K such that is a regular value of //. If K = 5*0(3), suppose also that there exists a 
component F of the fixed point set M T of the maximal torus T such that the constant value 
taken by the T -moment map \it on F 'satisfies > 1, and if K = SU{2) suppose that 

there is an F for which \ht{F)\ > 2 and that there is no F with ^t{F) = ±1 = ^f,± where 
np^± is the sum of the positive (respectively negative) weights for the action of T on the 
normal to F m M. Then RR K (C) = RR(C vcd ). 

Our original motivation for considering Riemann-Roch numbers was to provide a link 
between the residue we had defined and more standard definitions of residues in algebraic 
geometry (such as the Grothendieck residue fl6|]). We had defined the residue as the eval- 
uation at (suitably interpreted) of the Fourier transform of a particular function on t: in 
the case when T has rank one, this may be identified with the residue at of a meromorphic 
function on C whose poles occur only at 0. Moreover, when T has rank one, the special case 
of our residue that arises in computing RR(C Tcd ) may be recast as the residue of a mero- 
morphic 1-form on the Riemann sphere C at one of its poles. This same expression arises 
when one computes RR K (C) by using the holomorphic Lefschetz formula to give a formula 
for the character x(^) °f the action of an element k of K on 7i and then integrating x{k) 
over the group K to get the dimension of the if-invariant subspace 7i K . Since writing this 
paper we have found that it is possible to extend its methods to treat the case when K has 
higher rank (see [@); however the arguments become more involved. 

Since we first began considering the application of the residue formula to Riemann-Roch 
numbers, several papers have appeared which extend the Guillemin-Sternberg result to a 
wider class of situations, and in which the main tool is localization in equivariant cohomology. 



There are two approaches, one due to Guillemin |13[, the other due to Vergne pq| . 

Guillemin's proof uses the residue formula to reduce the verification of (1.5) to a com- 
binatorial identity involving counting lattice points in polyhedra. Guillemin then observes 
that this identity is known when K is a torus acting in a quasi-free manner. Meinrenken 
pSfl has subsequently extended this proof to torus actions which need not be quasi-free. 

As has been pointed out by Guillemin (|[L3|, Section 3), the application of the residue 
formula to yield a formula for RR(£ rc d) requires only that there exist an almost complex 
structure on M compatible with the action of K: such a structure enables one to define a 
spin-C Dirac operator which can be used to define the virtual vector space TC. Guillemin 



and Sternberg's original proof |14| , on the other hand, depends on the existence of a Kahler 



structure on M and on some positivity hypotheses that are not necessary in the approaches 
based on equivariant cohomology. Thus the use of localization in equivariant cohomology 
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extends Guillemin and Sternberg's original result to a more general situation. The obser- 
vation that it suffices to assume the existence of a iT-invariant compatible almost complex 
structure on M applies likewise to the proof we shall present. 

Vergne [23] has given a different proof of the Guillemin-Sternberg conjecture when K is 
a torus, also using ideas based on localization in equivariant cohomology. Her proof likewise 
does not require positivity hypotheses or the existence of a .fT-invariant Kahler structure on 
M. 



In later work, Meinrenken EM has proved the Guillemin-Sternberg formula for gen- 



eral compact nonabelian groups K; the only hypothesis he imposes is that the symmetric 
quadratic form on the tangent space to M given by the symplectic form and the almost 
complex structure should be a metric (i.e., that it should be positive definite). 

Although many features of the rank one case are quite special, and although the proofs 
of Vergne and Guillemin-Meinrenken described above apply in much greater generality, we 
felt nevertheless that it was instructive to give a written account of our approach to this case 
since it is simple and self-contained. 

The layout of this paper is as follows. In Section 2 we review some basic facts about 
equivariant cohomology, and find an equivariant cohomology class rj on M mapping to the 
Todd class of M re d under the natural surjection /to : H^(M) —>■ if*(M re d), so that 

r) = Td(M rcd ). 

By the Riemann-Roch formula we have 

RR{£ Ied ) = r) e"°[M Ied ), (1.6) 

provided M re d is a manifold, which is true if K acts freely on /i _1 (0); in the more general 
case RR(£ ve d) is given by Kawasaki's Riemann-Roch theorem for orbifolds (Theorem 6.1). 
In Section 3 we apply the residue formula to give a formula for the right hand side of (|1.6| 
as a sum over the components of the fixed point set M T of T. In Section 4, we apply the 
holomorphic Lefschetz formula to obtain a similar fixed point sum for RR K (£ re d); finally in 
Sections 5 and 6 we identify the two expressions. 

Acknowledgement: We thank Miles Reid, who originally proposed that we should investigate 
the possibility of trying to reformulate the residue in |T7J in more algebro-geometric terms, 



and suggested that there should be a relation between our residue formula and the Riemann- 
Roch theorem. 



2 Preliminaries 

If M is a compact oriented manifold acted on by a compact connected Lie group K, the K- 
equivariant cohomology H^(M) of M may be identified with the cohomology of the following 
chain complex (see Chapter 7 of 0): 

Q* K (M) = (S(k*) ® Q*(M)) K (2.1) 
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equipped with the different ial[] 



D = d - u Xm (2.2) 
where Xm is the vector field on M generated by the action of X £ k. The natural map 

t m : H* K (M) -> F£(M) (2.3) 

corresponds to the restriction map 

^(k*) ® fi^Af))* -> 5(t*) <g> 0*(M). 



We shall make use of equivariant characteristic classes on M: for their definition see 
Section 7.1 of §. 

Proposition 2.1 The equivariant Chern character of the line bundle C is 

ch K (C)(X) = Tr(e w+ ^' x) ) £ fc K (M). 

Here, X is a parameter in k, and Cl* K (M) is the formal completion of the space Q* K (M) of 
equivariant differential forms on M. 

Suppose F is a component of the fixed point set of T in M. We may (formally) decompose 
the normal bundle vp to F (using the splitting principle if necessary) as a sum of line bundles 
vp = X),-=i u F,j, in such a way that T acts on upj with weight £ t*.Q The T-equivariant 
Euler class ep of the normal bundle i^f is then defined for X £ t by 

e F (X) = nMz/jy) + ^F,i(X)). (2.4) 
Recall that the Todd class of a vector bundle V is given in terms of the Chern roots xi 

by 

Td(v)=n T ^ r =ETd i (n 

I 1 e j>0 

where Tdj is a homogeneous polynomial of degree j in the X[. If the Todd class is given in 
terms of the Chern roots by 

Td = t(x u ...,x n ) 

then the T-equivariant Todd class of the normal bundle Vp is given for X £ t by 

Td T (v F )(X) = rfdKO + ip F ,!(X), . . ., Cl (v F , N ) + ip F , N (X)). (2.5) 



1 This (nonstandard) definition of the equivariant cohomology differential is different from that used in 
|L7fl but consistent with that used in |2^| . We have found it convenient to introduce this definition to obtain 
consistency with the formulas in Section 4. 

2 Throughout this paper we shall use the convention that weights /3fj € t* send the integer lattice 
A 7 = Ker (exp : t -> T) to Z. 
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We may also define the i^-equivariant Todd class Td.R-(V) of any if -equivariant vector 
bundle V on M, and in particular the equivariant Todd class Td^(M) = Td^- (TM) of M. 
We have TAf(Tdx(^)) = Tdr(V) and TAf(chx(£)) = chr(£), where tm is the natural map 
introduced at (|2.3| ). Moreover one may define the inverse equivariant Todd class 



(Td K )-\V) = Y,((Td K )- l UV) 

as the equivariant extension of the class Td _1 (V) given in terms of the Chern roots by 

1 — p~ x i 

Td-\V) = i[^—. 

i i 

The surjective ring homomorphism n Q : H* K (M) — > if*(M red ) mentioned in the introduc- 
tion is the composition of the restriction map from H^-(M) to H* K {^ l {Q)) and the natural 
isomorphism from -ff]^(/x _1 (0)) to H*(M Te d) which exists since K acts locally freely on /x _1 (0) 
and we are working with cohomology with complex coefficients. This surjection is zero on 
H 3 K (M) for any j > dimR(M red ), and so it makes sense to apply kq to formal equivariant 
cohomology classes such as the equivariant characteristic classes we have been considering. 

Proposition 2.2 We have 

Ko (Td^(M)(Td / 0- 1 (k ad © k: d )) = Td(M red ), 

where k is the natural surjective ring homomorphism H^(M) — ► ii"*(M red ). Here, k ad 
denotes the product bundle Mxk where k is equipped with the adjoint action of K , and k* d 
denotes the product bundle Mxk* where k* is equipped with the coadjoint action of K. 

Proof: The normal bundle z^(/x _1 (0)) to /x _1 (0) (which is a submanifold of M since is 
a regular value of /x) is isomorphic as an equivariant bundle to k* d (since /x : M — » k* 
is an equivariant map). Moreover, when K acts freely on /x _1 (0), we have the following 
decomposition of TM in terms of if-equivariant bundles: 

TM| M -i (0) = ro*- 1 (o))ei< d 

and T(/x- 1 (0)) = vr*TM red © k ad where 7i : \l 1 (0) — > M red is the natural projection. □ 
The following is an immediate consequence of (|2.5| ): 



Lemma 2.3 For X 6 t ; the T -equivariant Todd class o/k ad © k* d is given by 

l(X) 

7>0 

where the product is over the positive roots, and we have introduced^ 7 = 7/(271"). 



Td T (k ad © k: d )(x) = n ( i_ e ^ 7 ))(i- e -^)) » ( 2 - 6 ) 



When K is abelian the bundle Td^(k ad © k* d ) is equivariantly trivial as well as trivial, and 
so we have in this case 

K (Td K (M)) = Td(M red ). (2.7) 



3 The extra factors of 1/ (2ir) are introduced because of the convention explained in Footnote 2 that weights 
(3 € t* satisfy (3 6 Hom(A / ,Z) rather than (3 E Horn (A 1 , 2irZ). Our definition of roots is as in Lemma 3.1 
of |ri| : thus the roots 7 satisfy 7(A 7 ) C 2irZ. In the terminology of || (p. 185), the quantities 17 : t — > iR 
are the infinitesimal roots whereas the corresponding weights 7 are the reaZ roots. 
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3 Review of the residue formula 



We now recall the main result (the residue formula, Theorem 8.1) of [171: 



Theorem 3.1 [jTfl] Let r] G H* K (M) induce r) G H*(M ied ). Then we have 



r/ e W0 [M red ] = n C K resiw 2 (X) £ r F (X)[dX}l (3.1) 

^ FeJ 7 ' 

where n is the order of the subgroup of K that acts trivially on /i _1 (0), and the constant 
C K is defined by 



~ (2ic)'- l \W\vol(T)' 1 ; 

We have introduced s = dim.fr and I = dimT. Also, T denotes the set of components of the 
fixed point set ofT, and if F is one of these components then the meromorphic function r F 
on t ® C is defined by 

r F (X) = c <M*0W f (3 _ 3) 
Jf e F (X) 

Here, ip : F — > M is the inclusion and ep is the T-equivariant Euler class of the normal 
bundle to F in M , which was defined at t\2.$) . The polynomial w : t — > M is defined by 
w{X) = rL>o7pO; where 7 runs over the positive roots of K. 



The general definition of the residue res was given in Section 8 of HPT |. Here we shall treat 
the case where K has rank 1, for which the results are as follows. See Footnotes 2 and 3 for 
our conventions on roots and weights. 



Corollary 3.2 f|L7|; gg, [PH ) In the situation of Theorem gj, let K = U(l). Then 



rjae" [M red ] = m res ( £ r F (X)dX(X)). 



Here, the meromorphic function r F on C was defined by ( \3.3\ ), and reso denotes the coefficient 
of the meromorphic 1-form dX{X)/X{X) on k (g) C, where X G k and X is the generator of 
the weight lattice ofU(l). The set T + is defined by J- " + = {F G T : ^t{F) > 0}. The integer 
n is as in Theorem \3. % 



Corollary 3.3 (cf. [|17|], Corollary 8.2) In the situation of Theorem^, let K = 377(2) 
or K = 50(3). Then 



r) Q e»°[M Ied ] = yres ( 7 W 2 £ r F (X)dX(X)). 

Here, reso, r F and T+ are as in Corollary \3. Sj , and X = Xk G t* is the generator of the 
weight lattice of K. We have Xso(3) = 7 and Xsu(2) = 7/2, where 7 = 7/(271") was defined in 



terms of the positive root 7. The integer no is as in Theorem 3.1 
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We now specialize to the case rj = Td(M re d). Assume that T acts at the fixed point F 
with weights f3 F j £ t*. From now on we assume that the action of K on /i _1 (0) is effective, 



so that no = 1 in Theorem 3.1 



Proposition 3.4 We have 

f ch(£ red )Td(M red ) = C^resf £ w 2 (X)e l ^ x \Td T )-\K d © K d )(X) (3.4) 

f e"Td T (v F )(X)Td(F) \ 
Jf e F (X) J' 

This is equal to RR(C Ted ) provided K acts freely on u _1 (0). 

Here, the constant C K was defined at (|3.2| ). We have used the definitions of equivariant 
characteristic classes given in Section 2. We have also decomposed the restriction to F of 
the T-equivariant Todd class of M as 

Tdr(M)pf) = Td T (z/ F )(X)Td(TF). (3.5) 

Here, we have used the multiplicativity of the Todd class and the fact that the action of T 



on TF is trivial. Then the Proposition follows immediately from Theorem p4 
The special case of Proposition |3.4| when K — U(l) is: 

Proposition 3.5 If K = U(l), we have 

( ch(£ red )Td(M red ) = zres ( £ / dX{X)) (3.6) 

Jif rpH v "-z, Jf e F [X) 7 



This is equal to RR(C md ) provided K acts freely on // _1 (0). Here, X 6 t and reso denotes 
the coefficient of the meromorphic 1-form d\(X)/X(X) on t ® C, where the element A G t* 
is the generator of the weight lattice oft. 

The corresponding result for K = SU(2) or K = 5*0(3) is 

Proposition 3.6 Let K = SU(2) or K = SO (3). Then we have 

f ch(£ red )Td(M rcd ) = ^reso((l-e^)(l-e-^) £ e *^W) (3.7) 

^Td r MWTd(F) . 
e F {X) ' 

This is equal to RR(C ied ) provided K acts freely on /x _1 (0). Here, let, and res denotes the 
coefficient of the meromorphic 1-form d\(X) / X(X) on t<8>C, where the element X = Xk € t* 
is the generator of the weight lattice of K; also, Xso(3) = 7 = 7/(277) where 7 is the positive 
root of 5*0(3), and Xsu(2) — 7/2, as i/ie statement of Corollary pT 



Notice that it is valid to apply the residue formula for groups of rank one to formal 
equivariant cohomology classes in this way, because both sides of the formula send to zero 
all elements of H J K (M) when j > dimn(M Ted ). 
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4 The holomorphic Lefschetz formula 



We now describe the application of the holomorphic Lefschetz theorem in our situation. 
The theorem is proved by Atiyah and Singer (0, Theorem 4.6), and is based on results of 
Atiyah and Segal ||: an exposition of the general result from which the theorem follows is 
given in Theorem 6.16 of 0. A more general equivariant index theorem involving equivariant 
cohomology is proved by Berline and Vergne in jTj . The following statement is in a form that 
will be convenient for us. We introduce the notation that if X G Lie(T) then t = exp(X) e T. 
For any weight (3, we define t 13 as exp(2iiij3(X)) e U(l) C C x , where the weights (3 have 
been chosen to send the integer lattice A 7 in t to Z C R. 

Theorem 4.1 (Holomorphic Lefschetz formula) Let t G T be such that the fixed point 
set of t in M is the same as the fixed point set U F( .-pF ofT in M; then the character x(t) 
of the virtual representation oft onTi is given by 

x(t) = E XF(t), 

FtT 

where 

XFit) ~ J F T[ 3 (l-t-^e-^)) (4 ' 1} 



Jf Ui(l-t-fcje- c 



If 11/(1 - t-P^e-^F^) 

Here, the (3pj G Horn (T, U(l)) C t* are the weights of the action ofT on the normal bundle 
vp of F in M , and the T -moment map \it is the composition of \i with restriction from k* 
to t*. 



Proof: Equation ( |4.1|) follows immediately from the statement given in Theorem 4.6 of jp. 
We need only observe that the action of t on the fibre of £ above any point in F is given by 
multiplication by t«"( F ). Thus i* F ch T (C)(t) = e u t^ F \u 

When the T action has isolated fixed points, (fOT) reduces to 



XF (t) = — -— (4.2) 

rij(i -t-fcj) y ' 



In the general case, the structure of the right hand side of (|4.1| ) is given as follows: 
Lemma 4.2 The expression 



LTj(l - t-^e- Cl ^)) 

appearing in is given by 

j rj>0 

In particular the only poles occur when = 1. 



ng (iIW^ ■ (4 ' 3) 
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Proof: This follows by examining for each j 



1 _ 1 1 y r u r 

1 _ t-^ie-dC^) ~ + ~ 1 -y r V (1 - 2/) r 

where ?/ = and w = e -01 ^'^ — 1 is nilpotent. □ 

We restrict from now on to the case T = 2/(1), which is regarded as embedded in C in 
the standard way. We identify the weights with integers by writing them as multiples of the 
generator A of the weight lattice of 2/(1). 

Proposition 4.3 The character x(t) extends to a holomorphic function on C x = C— {0, oo}. 

Proof: This follows since x is the character of a finite dimensional (virtual) representation 
of £7(1), so it is of the form x(t) = Dmez c m,t m for some integer coefficients c m , finitely many 
of which are nonzero. □ 

The following is immediate: 

Proposition 4.4 The expression xf given in defines a meromorphic function on C 

such that Y^F G f XF{t) agrees with x{t) on the open subset ofU(l) consisting of those t whose 
action does not fix any point of M — M T . Hence, by analyticity, x(t) = J2 Fe f XF(t) on an 
open set in C containing C x —2/(1). 



Proposition 4.5 The virtual dimension of the T -invariant subspace ofTL is given by 

Ztti i t er t sr- 

F£_T 



where Xf was defined after ( U-A) - Here, for any e > 0, T = {t G C : \t\ = 1 + e} C is a 



cycle in C on which the Xf have no poles. 
Proof: This follows since 

2irt J\t\=i t 
If dt , . 
2m J\t\er t 

and by applying Proposition fO| to identify x with J2 F£ j^Xf on T. □ 

Remark: One obtains an equivalent formula by defining r = {t G C : \t\ = 1 — e} for 
< e < 1. 

Let us now regard 

/ n d t d t „ <f) f e w Td(F) . , 

h F = XF(t)— = —t^ F) / — R , vT 4.5 

Ay 't t JFYijil-t-foje- ^^) y ' 



10 



as a meromorphic 1-form on C, whose poles may occur only at 0, oo and s e Wp, where we 
define 

Wf = {s 6 U(l) : sP** = 1 for some f3 FJ }. (4.6) 

(This is true by inspection of ( |4.2[ ) when the fixed point set of the action of T consists of 
isolated points. In the general case it follows from Lemma f4.2| .) The integral ( |4.4|) then 
yields 

dimH T = - Yl r eSoo/iF- (4.7) 

Let us examine the poles of h F on C. We have 

Lemma 4.6 For a given F, letn,F,± be J2j:±p Fj >o \Pfj\- If ^t(F) > —np,+ thenresohp = 0, 
while if ht{F) < n F- then res^/ip = 0. 

Proof: To study the residue at 0, we assume \t\ < 1, so that (1 — t) _1 = J2n>ot n an d 
(1 — t -1 ) -1 = —tJ2n>ot n - F° r ^ > 1 we examine 

dt 

Uj{i-t-^yT 

= t MF)(_iy +t ™ F , + (j[ £ t^^Y-, (4.8) 

3 nj>0 t 

where l + is the number of fipj that are positive. It follows that if Uf,+ + Ht(F) > then 
the residue at is zero. A similar calculation yields the result for the residue at oo. □ 

Recall that the action of T on M is said to be quasi-free if it is free on the complement 
of the fixed point set of T in M. The following is shown in [|K]]: 

Lemma 4.7 The action of T = £7(1) on M is quasi-free if and only if the weights are 
/3 Ftj = ±l. 



Proposition 4.8 // the action of T is quasi-free, then we have 

res^ h F = - resi/i F . (4.9) 
FeJ 7 F&F+ 

Here, J r + = {F 6 T : ^t(F) > 0}. More generally the result is true ifresihp is replaced by 
J2se\v F Tes shF, where the set Wf was defined at ^j.b\ ). 

Proof: Assume for simplicity that the action of T is quasi-free: the proof of the general case 
is almost identical. Lemma ^]6| establishes that 

resoo Y h F = res oo^F- 
FeJ 7 FeJ r + 
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Also, if F E T + then Ht(F) > — n + so resohp = 0; hence (|4.9|) follows because the mero- 
morphic 1-form hp has poles only at 0, 1 and oo and their residues must sum to zero, so 
resihp = — res^/iF when F G J-+.0 

Remark: Recall that Ht{F) is never zero. 



The following is an immediate consequence of combining Proposition [4.8| with Proposition 

O: 

Corollary 4.9 If the action ofT = U(l) on M red is quasi-free, we have RR T (C) = J2 Fe p + resi/ip. 
More generally we have RR T (C) = J2 F( zf + Ssew F res s^F, where Wf was defined by (j.b). 

We now treat the cases K = SU(2) and K = 5*0(3). We shall first need the following 

Lemma 4.10 There is no component F of the fixed point set ofT on M for which Ht{F) = 
0. 



Proof: Because the K moment map is equivariant, fi(F) is fixed by the action of T on k* for 
every FgJ 7 ; thus fi(F) C t (identifying k with k* and t with t* by the choice of an inner 
product), so that fi(F) = ht{F). Thus ^t(F) = implies fi(F) = 0. However, because K 
acts locally freely on /i _1 (0), no F may intersect (()).□ 

We shall prove the following result: 

Proposition 4.11 (a) Suppose M is connected, and suppose K = SO (3) acts on M in 
such a way that the action of T is quasi-free. Suppose also that there exists F for which 
\pr(F)\ > 1. Then 

RR K (C) = ^ J2 res 1 (2-t-r 1 )/i F 
FeF+ 

where the meromorphic 1-form hp on C was defined by j\4-3j )- More generally we have when 
K = 5*0(3) (provided there exists F for which |//t(F)| > 1) that 

RR K {C)= l -Y. E res s (2 -t-r> F , 

FeF+ 

where Wf was defined by l \4-b\ )- 

(b) Let K = 577(2), and suppose that there is an F for which \[it(F)\ > 2, and also that 
there is no F with either fir{F) = 1 and Uf,+ = 1 or fir{F) = —1 and Up- = 1. Then we 
have that 



RR K (C) = l ]T £ res s (2 -t 2 -r 2 )h F . 
FeF+ 

Proof: (a): If K = 50(3), we have by the Weyl integral formula for Lie groups that 

1 r 1 1 r dt 

dimH K = —— / dk X (k) = —— / - t)(l - r l ) X (t) (4.10) 

vol K Jk&K W 2m Jt&T t 
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1 1 



2 2ni Jter t 



dt 



(2-t-r 1 ) x (t) 



l l 



dt 



2 2tt2 iter t V ; 



e w Td(F) 



(In ( 4.1l)p , the factor (1 — t)(l — t~ r ) is the volume of the conjugacy class of K containing 
t, in a normalization where volK = 1: see for instance 0, (IV. 1.11).) By the previous 
argument (Lemmas |4.2| to |4i|), this is equal to 



dim7i 



K 



-- £ res 00 (2-t-r 1 )/i J r 



(4.11) 



where the meromorphic 1-form hp was defined at ( |4.5| ). By the proof of Lemma ^4.6| this 
becomes 



;(2resi ^2 h F — resi 



E 



th F — resi 



E 



r l h, 



(4.12) 



FgJF + FeJ r ,^ T (F)+l>n F _ FeJ 7 ,fj, T (F)-l>n F ,- 

By Lemma |4.10| , ^t(F) ^ for any F; thus it suffices to check that 



^ resx(thp) 

FeJ 7 : Mt(F)+1>"f,- 



^ Tesx(thp) 

F&T: At T (F)>0 



(4.13) 



and likewise that 



res 1 (t- l h F )= J2 resi(t~ l h F ). (4.14) 

F&T: iir{F)-X>n F - FeJ 7 : fi T {F)>0 

Equation ( |4.13| ) follows by the proof of Lemma ^4.6| , unless np_ = and Ht{F) = — 1: we 
apply the proof, replacing ^t(F) by fir(F) + 1 and using the fact that for any r G Z, 

res (t r hp) = reSoo(t r hp) = if Ht(F) + r E [-n Fj+ + 1, n F) - - 1]. (4-15) 

Likewise, equation (|4.14|) follows unless n^ i+ = and Ht(F) = 1. However if (fi T (F),n F _) = 
(—1,0) then F gives a local minimum of \xt- Since M is connected and fip is a perfect 
Morse function ([^TJ, (5.8)), the local minimum must be a global minimum, contradict- 
ing the assumption that there exists an F' for which \/it(F')\ > 1.0 Similarly the case 
(HT{F),n Fy _) = (1,0) gives a maximum of fip and hence cannot occur. 

(b) UK= SU(2) we obtain instead of ( pp 



dim7i K = -(2resi ^ ftp — resi ^ t 2 /i^ — resi ^ 

FeJ r + FeJ r , f i T {F)+2>n F _ FeF \n T (F)-2>n F . 



r 2 h, 



(4.16) 

Using (|4.15|) we find that the second sum in ( |4.16j ) is equal to — resi Z)^ 6 jF AtT (F)>o ^^f 
except when \i T {F\np_) is (—2,0), (—1,0) or (—1,1). Likewise the third sum is equal 

4 Recall that by Weyl symmetry there exists F' for which ht(F') > 1 if and only if there exists F' for 
which ht{F') < — 1. 
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to — resi Z) i r g jF AtT (F)>o ^ 2 ^ F exce Pt when (^(F) , np,+) is (2,0), (1,0) or (1,1). The first, 
second, fourth and fifth of these six cases are excluded if we assume that there is some F 
with \{i T (F)\ > 2. □ 

Remark: The technical hypothesis in Proposition 4.111 (a) that there should exist F for which 
|/xt(-P) I 7^ 1 can be satisfied by replacing C by C k with k > 2. Similarly the technical 
hypotheses in |4.11| (b) can be satisfied by taking k > 3. 



5 Identification with the residue formula 

In this section we shall assume the weights are f3pj = ±1, so that the action of T on M is 
quasi-free. In order to treat the general case one needs to use Kawasaki's Riemann-Roch 
theorem for orbifolds |20f|: we do this in the next section. 



Let us examine the residue resi/iF in the case K = U(l). We denote a generator of the 
weight lattice of t by A, and replace the parameter t (in a small neighbourhood of 1 e C) by 

t = e iA(x) (5.1) 

(where X G t £g> C is in a small neighbourhood of in t Cg) C), so that 

- = id\{X) 

defines a meromorphic 1-form on t (g) C. (The substitution ( |5.1|) differs from the substitution 
used in Section 4, where we set t = e 2mX ( x ); however the value of the residue obviously is 
independent of which of these substitutions is used, and the substitution ( |5.1| ) yields the 
formulas in Section 3.) 

We then find that 

= ^ MF,m I n . (1 JS-^)) ^)) < 5 ' 2 > 



zreso I e 



4"™" / n7 fl dT( m + Y>T , d(f ?/ A <- Y »- ^ 

If Uj^PF,j[X) + c x [y F J)) ' 

e^Td T (z/ F )(X )Td(F) 
If e F (X) 

where reso denotes the coefficient of d\(X)/X(X). Combining ( |5.4| ) with Proposition [375 
one obtains 

Proposition 5.1 We have 

f ch(£ red )Td(M red ) = Yl res i^- ( 5 - 5 ) 

This equals RR(£ ve d) provided K = U{1) acts freely on /i _1 (0). 
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Comparing Proposition |5.1| with Corollary [4.9|, we have 



Proposition 5.2 Let the action of K = U(l) on M be quasi-free (which implies K acts 
freely on /^(O) ). Then RR K (C) = RR(C red ). 

To treat K = SO(3) and K = SU(2), using the substitution ( |5.1| ) in resi(2 — t — t~ l )h,F, 



we recover the right hand side of Proposition [5\6 : 
Proposition 5.3 Let K = SO (3) or SU(2) act on M. Then 

f ch(£ rcd )Td(M rcd ) = \ re Sl (2 - t - r> F . 

This equals RR(£ Te d) provided K acts freely on /i _1 (0). 
Combining Proposition [5.3| with Proposition 4.11 we get| 



Proposition 5.4 Let K = SO(3) act on M in such a way that the action ofT is quasi-free 
(which implies K acts freely on /i _1 (0) y ). Then RR K (C) = RR(C Te(i ). 

Thus we have 

Theorem 5.5 Suppose T = U(l) and either K = U(l) or K = SO(3). Suppose K acts 
in a Hamiltonian fashion on the Kahler manifold^ M , in such a way that the action of T 
is quasi-free. If K = SO(3), suppose also that there exists F for which \fi T (F)\ > 1. We 
assume a moment map fi for the action of K has been chosen in such a way that is a 
regular value of fi. Then RR K (C) = RR(£ ve <i). 



6 Kawasaki's Riemann-Roch theorem 

In this final section we sketch the proof of the Guillemin-Sternberg result RR(C ve d) = 
RR K (C) when K has rank one, without the assumption that the action of T is quasi-free. In 
this more general case, M re d is an orbifold and £ re d an orbifold bundle. The Riemann-Roch 
number of £ re d is then given by applying Kawasaki's Riemann-Roch theorem for orbifolds. 
We state Kawasaki's result only as it applies in our particular situation: the special case 
when K = T in fact appears in earlier work of Atiyah. 



5 We do not treat K = SU(2), since in this case the action of T can only be quasi-free if all the F are in 
the fixed point set of K. For unless F is fixed by all of K, the orthocomplement t ^ of t (equipped with the 
adjoint action) injects into the normal bundle vp under the action of K. There is thus a subbundle of vp 



on which T acts with weight 2 or —2, and so the action of T cannot be quasi-free by Lemma 4.7. 

6 As described in the Introduction, it actually suffices to assume that M is equipped with a if-invariant 



almost complex structure compatible with the symplectic structure. This applies likewise to Theorem 6.2 
below. 
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Theorem 6.1 (Atiyah []TJ; Kawasaki ||20|| ) The Riemann-Roch number of the orbifold 
bundle £ red is given by 

RR(C ied ) = I ch(£ rcd )Td(M red ) + Y, E — / JS ' a - ( 6 - 6 ) 

Here, S is a set of representatives s G T for the conjugacy classes in K of elements whose 
fixed point set M s is strictly larger than the fixed point set of any subgroup of K of dimension 
at least one. The components of M s are denoted M" ; where a G A s ; we introduce M® ,a = 
Mg fl /i _1 (0), and M" red = M®' a /K s where K s is the centralizer of s in K. The positive 
integer ra s a is the order of the stabilizer of the action of K s at a generic point of M". The 
class T' a G #*(M s a red ) is defined by 

JS , a = ch(£° red )^°Td(M° red ) 

" n feeKa (i-s-^ fc e- ci K^))' 

Here, fi a is the weight of the action of s on the fibre of C over any point in Mf and C a s red is 
the induced orbifold bundle on M" red . If v(M" d ) denotes the orbifold bundle which is the 
pullback to Mg Tcd of the normal to the image of the natural map from M°' a to /i _1 (0), we 
decompose i/(M" red ) as a formal sum of line bundles 

v(M a s ) = ® k e. a v s ,a,k, (6.8) 

and denote by fi s ,a,k G Z the weight of the action of s on the formal line subbundle of the 
normal bundle to M s 0,tt in /i _1 (0) corresponding to v s ,a,k- 

We can use this Theorem to prove Guillemin and Sternberg's result for groups of rank one, by 
identifying the additional terms on the right hand side of (|6.6|) with the additional residues 



at the points 1 7^ s G Wp that appear in the statement of Proposition [4.8| when the action 



of T is not quasi-free. Meinrenken uses Kawasaki's theorem in a different way to eliminate 



the quasi-free action hypothesis from the proof given by Guillemin in [13]: see [p3 |, Remark 
1 following Theorem 2.1. 

The proofs of Corollary [19] and Proposition 4.11 give when K = T 



RR K (C) = E E ( E ^sh F ), (6.9) 

s&S a&As FeJ r + :FcM^ 

and when K = SO (3) or SU(2) 

RR K (C)= Y E( E res s (2-t-r> F /2), (6.10) 

where the meromorphic 1-form hp on C was defined at ( |4.5| ) and W is the Weyl group of 
K. The terms in the second sum indexed by different elements s of the same Weyl group 
orbit are equal, so the sum can be rewritten as a sum over S instead of WS. We know from 
Proposition |0| (a consequence of applying the residue formula to the class ch(£ red )Td(M red ) 
on M red ) that the term in each of these sums indexed by s = 1 is 

/ ch(£ rcd )Td(M red ). (6.11) 

JM vnd 
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To deal with the other terms we apply the residue formula (Theorem |3.1| ) to the action 
of K s on the symplectic manifold M®: in the notation of that theorem, we introduce an 
appropriate equivariant cohomology class rje^ = 1 s ^ s G (Mg) which descends on the 
symplectic quotient M" rod to X s,a = rjoe^ . When K = T the class X^ a is given by 

J^ a = ch T (L)s^Td r (M s a )( [] (1 - s-^e-^-^^r 1 ) (6.12) 

where C\(v s ^k) T is the T-equivariant first Chern class of the virtual line bundle v s>a ^. In 
the other cases T s £ is defined similarly, using Proposition 2.2 applied to K s . This yields for 
each s G 5 and a G A s that the term in the right hand side of ( |6.9| ) or fl6.10| ) indexed by s 
and a is 

' ' T> a . (6.13) 



(Here, the factor n s>a is the order of the subgroup of K s that acts trivially on M": see the 
statement of Theorem |3.1| .) Substituting (|6.13|) in ( |6.9|) or (|6.10|) we recover the right hand 



side of ( |6.6|) . Thus we obtain the Guillemin- Sternberg result in the special case when K has 
rank one: 



Theorem 6.2 Suppose that a compact group K with maximal torus T = U(l) acts in a 
Hamiltonian fashion on the Kahler manifold M , in such a way that is a regular value of 
fi. Then if the hypotheses of Proposition 4- 11(a) and (b) are satisfied 



Remark: It has been pointed out to us by M. Vergne that there are examples (such as the 
action of SU (2) on the complex projective line) to show that this result is not true without 
some hypotheses such as those of Proposition 4.11. 
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